MARKOV PROCESSES ON TIME-LIKE GRAPHS 
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Abstract. We study Markov processes where the "time" parameter is replaced by paths in a 
directed graph from an initial vertex to a terminal one. Along each directed path the process is 
Markov and has the same distribution as the one along any other directed path. If two directed 
paths do not interact, in a suitable sense, then the distributions of the processes on the two paths are 
conditionally independent, given their values at the common endpoint of the two paths. Conditions 
\^ on graphs that support such processes (e.g., hexagonal lattice) are established. Next we analyze a 

particularly suitable family of Markov processes, called harnesses, which includes Brownian motion 
and other Levy processes, on such time-like graphs. Finally we investigate contiimum limits of 
harnesses on a sequence of time-like graphs that admits a limit in a suitable sense. 

< 

(N 

I— I 1. Introduction 

Oh Classical stochastic processes are families of random variables {Xt,t £ T}, where T is a subset of 

M, for example, positive integers or [0, oo). A notable exception is the family of Gaussian processes, 
g for which the structure of the parameter space T can be virtually arbitrary. For the other two most 

I— —I popular families of stochastic processes, that is, Markov processes and martingales, the situation 

is much more complicated. The theories of Markov processes and martingales with the parameter 
^ set T equal to an orthant in M"^ are hard, less developed, less popular, and less frequently applied 

CN than the original theories with one-dimensional T- A book by Khoshnevisan ^ is an excellent 

monograph devoted to this field of stochastic processes. 

This article introduces a class of stochastic processes where the "time" parameter has been 

replaced by paths in a directed graph. Our goal is to construct a time structure that matches the 

Markov property better than other non-rectilinear time sets known in the literature. A number 
. ^ of models with tree-like time parameter sets have been studied, for example, branching Brownian 

^ motion (see ^ Sect. 1.1]), and its much more complex version known as Le Gall's Brownian snake 

^ (see ^ Sect. 3.6]). Other examples include the Brownian web and the Brownian net — see 

In all these models, stochastic processes are defined, in a sense, on random graphs. In contrast, we 

will be concerned with a deterministic parameter space. 

IC.HKM T. 

In statistics, graphical models are widely used (see \\m liuj ) in areas such as Bayesian data anal- 
ysis, modeling of causal relationship, information retrieval, and language processing. These are 
probability distributions of a countable number of random variables indexed by the vertices of a 
graph where the graph structure induces a set of conditional independence constraints (called the 



2000 Mathematics Subject Classification. 60J60, 60G60, 60J99. 

Key words and phrases, harness; graphical Markov model; time-like graphs. 

Research supported in part by NSF Grant DMS-0906743 and by grant N N201 397137, MNiSW, Poland. 

1 



2 



KRZYSZTOF BURDZY AND SOUMIK PAL 



graphical Markov property). One can think of our models as a continuous time analogue of such 
discrete graphical models where the classical Markov property is preserved. 

Informally speaking, the following describes our set-up. Consider the law of a classical Markov 
process V in the interval [0, 1]. Consider a finite graph with two distinguished vertices marked "0" 
and "1", and every other vertex is labeled by a real number between zero and one. Consider the 
collection of all paths (i.e., a sequence of vertices) starting at and ending at 1 such that successive 
vertices are increasing and share an edge in the graph. Such paths can be seen as homeomorphic 
images of the unit interval [0, 1]. Thus every such path indexes a copy of the Markov process with 
law V. We require the additional constraint that the process is defined uniquely at every vertex. 

Barring trivial example, it is not easy to even claim that such processes exist. In fact, the 
existence and uniqueness of the process depends critically on the structure of the underlying graph. 

ee c:TLG 
we define a collection of graphs which support such stochastic processes. We call these 
c :mkovconstruqtion 
we construct "natural Markov process on a 
^c:BM 

time- like graph" and prove its uniqueness in law. In Section |H] we provide examples of graphs that 
do not satisfy our conditions and do not support a "natural Brownian motion" . 

In the rest of the sections we focus on a class of laws V which are called harnesses. Harnesses, 

t c : harn 
include all integrable Levy processes and their corresponding bridges. The 

:licomb 

final Section |B] IS devoted to Brownian motion on the honeycomb graph and its limit as the diameter 
of hexagonal cells goes to zero. 



sec : TLG 



2. Time-like graphs 

Intuitively speaking, a time-like graph is a directed graph with Jordan arcs as edges. We will 

first consider graphs with finite numbers of vertices and edges. We will generalize our definitions 

Jaec,:NCC 



to infinite graphs at the end of Subsection BtT 



Definition 2.1. A graph Q = (V, £) will be called a time-like graph (TLG) if its sets of vertices V 
and edges £ satisfy the following properties. 

The set V contains at least two elements, V = {tQ,ti, . . . ,tAr}, where to = 0, = 1, G (0, 1) 
for fc = 1, . . . , — 1 and < t^+i for fc = 0, . . . , — 1. We do not exclude the case V = {to = 
0,tN = 1}. 

Formally, we should say that elements of V have the form (fc, tk), so that (fc, t^) and (fc + 1, tfc+i) 
are distinct even if tk = tfc+i- This would make the notation very complicated so we will write t^ 
instead of {k,tk)- This should not cause any confusion. 

An edge between tj and tk will be denoted Ejk- We assume that there is no edge between tj and 
tk if tj = tk- In particular, a TLG has no loops, that is, edges of the form Ejj. By convention, the 
notation Ejk indicates that tj < tk- We assume that the extreme vertices, to and t^, have degree 
1 and all other vertices tk have degree 3. We assume that for every vertex tk, except for to and tj\f, 
there exist edges Ejk and Ekn with j < k < n- 
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If there is a unique edge between tj and t^, j < k, then it will be denoted Ej^. If there are two 
edges between tj and t^, j < k, then they will be denoted E'jj^ and £'"^. We will write Eji^. to refer 
to one of the edges Ejj^ and Ej^^ when it is irrelevant which of the two edges is used. 

See Fig. [^f ^and ji^Below for examples of TLG's. We will next define a "representation" of a 
TLG, that is, a convenient geometric way to think about such a graph. The choice of space for the 
representation is not significant. We will limit ourselves to representations in because it is easy 
to see that every TLG has a representation in M.^. 



all . 1 Definition 2.2. By abuse of notation, let Ej^ : [tj, tfc] I^'^ denote a continuous function. Assume 
that the images of the open sets {tj,tk) under the maps t — )• {t,Ejk{t)) £ M'^, where Ejk G £, are 
disjoint. Suppose that Ejk{tk) = Ekn{tk) if Ejk,Ekn e £, and Ejk{tk) = E^kitk) if Ejk,Enk e £. 
We wiU caU the set TZ{Q) = {{t,Ejk{t)) £ [0, 1] x . ^.^ £ £,t e [tj,tk]} a representation of Q. 
We will say that Qi is a subgraph of G2 and write Qi C G2 if there exist representations of the two 
TLG's such that Tl{Gi) C Tl{Q2)- We will call Q a planar TLG if it has a representation Tl{G) C M?. 

Remark 2.3. There are many representations for a given TLG but there is a unique TLG corre- 
sponding to a given representation. 



def:2.4 Definition 2.4. We will call a sequence of edges (£'^^^2) -^^2^3; -^fcn-ifcn) ^ P'^^^ if ^ 
£ for every j; note that according to our conventions, ki < k2 < • • • < kn- We will write 
a{ki, k2,. - ■ , kn) to denote a time path {Ek^k^, Ek^^zi ■ ■ ■ , ^A;„_iA:„)- A time path a{ki, k2,.. . , kn) 
will be called a full time path if fci = and kn = N. 

Let ij = {tj, Ejk{tj)) for j < N and t^ = (^at, -E'Af-i,Ar(tAf)). Note that the definition does not 
depend on the choice of k. 

Remark 2.5. (i) Note that for every k € {0, ...,A^}, there exists at least one full time path 
a{ki,k2, ■ ■ ■ ,kn) such that km = k for some m. This follows easily from the assumption that 
for every vertex t^, except for to and t^, there exist edges Eji. and E/^n with j < k < n. 

(ii) If Q = {V,£) C Qi = {Vi,£i) and tj G Vi then tj G TliG) does not have the same meaning as 
tj e V. 

(iii) By abuse of language, for a time path ai = a{ki,k2, ■ ■ ■ ,kn), we will call the subset 
{{t, Ejk{t)) : Ejk G ai,t G [tj,tk]} of a representation TZ{G) a time path as well, li Q = {V,£) C 

= (Vi,<f:i), Ejk G £1 and {{t, Ejk{t)),t G [tj,tk]} C n{g) then we will write Ejk C 7^(^). Note 
that Ejk C TZiG) does not imply that Ejk G £. 



2.1. Time-like graphs with no co-terminal cells (NCC-graphs). We will define a subfamily 
of time-like graphs with properties that fit well with a probabilistic structure, to be presented later. 
We will give two definitions of time-like graphs with no co-terminal cells (NCC-graphs) and then 
we will show that the definitions are equivalent. Each definition is more useful than the other one 
in some technical arguments. 
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def :nci Definition 2.6. (i) We will say that time paths cr{j\, 32-, ■ ■ ■ ■, jn) and a{ki,k2, ■ ■ ■ ,kjn) are co- 
terminal if ji = ki and jn = km- 

(ii) A pair of co-terminal time paths j2, • • • ,jn) and CT{ki, k2, ■ ■ ■ , km) will be called a cell if 
{j2, • • • ,jn-i} n {k2, ■ ■ ■ , km-i} = 0- We will call tj^ the start of the cell and tj^ will be called the 
end of the cell. 

(iii) We will call a cell (cr(ji, J2) • • • ,jn),f^iki, k2, ■ ■ ■ , km)) simple if there does not exist time path 
a{ii,i2, . . . ,ir) such that ii G {j2, . . . , jn-i} and v G {^2, • • • , ^m-i}, or ii G {A:2, • • • , fcm-i} and 

V G {j2, ■ ■ • , Jn-l}- 

(iv) If tj is the start of a cell, let tj* be the smallest time tk such that there exists a cell with the 
start tj and end tk- A cell with a start tj and end tj* will be called forward-minimal. Similarly, if 
tk is the end of a cell, let t/-' be the largest time tj such that there exists a cell with the start tj 
and end tk- A cell with a start tk' and end tk will be called backward-minimal. We will call two 
cells minimal co-terminal cells if either they are forward-minimal and have different starts and the 
same end, or they are backward- minimal and they have different ends but the same start. 

(v) We will call a TLG an NCC-graph if it does not contain any minimal co-terminal cells. 



remrnoni Remark 2.7. It is easy to see that if a cell is forward-minimal or backward-minimal then it is simple. 

For example, suppose that a cell {(T{ji,j2, ■ ■ - ,jn),o'{ki, k2, - ■ ■ , km)) is forward-minimal and there 
is a time path a{ii, ^2, • • • , v) such that ii = jm G {j2, ■ ■ ■ , jn-i} and ir = kmi G {k2, - - - , km-i}- 
Then a{ji, . . . ,ini) ^2) • . ■ , v) and a{ki, . . . , kmi) form a cell with the end kmi < km, contradicting 
the assumption that fc| = fc^ 



The next definition, of the family of NCC*-graphs, is inductive and can be explained as follows. 
The simplest TLG Q, with a representation TZ{G) = [0, 1] x {0}, is included in this family. If a 
graph Qi already belongs to the family of NCC*-graphs then we add a time path to TZ{Gi), such 
that the endpoints of this new path lie on a time path already in Tl{Qi) and neither endpoint is a 
vertex already present in Tl{Qi). Thus amended representation corresponds to a TLG Q2 which we 
add to the family of NCC*-graphs. 



def :ind Definition 2.8. We will define NCC* -graphs in an inductive way. 

(i) The minimal graph Q = (V, £), with V = {to = 0, = 1} and £ = {Eq]\[}, is an NCC*-graph. 

(ii) Suppose that a graph Qi = (Vi,^!) is NCC*, where Vi = {to,ti, . . . ,tiy}- Suppose that 
tj,tk ^ Vi, tj < tk, and for some Ej^j^,Ek^k2 G £1, we have tj^ < tj < tj^ and t^i < tk < 
tk2- Let V2 = Vi U {tj,tk}- Assume that there exists a time path a{mi,m2, - - - ,m.n) such that 
ji = m„j,j2 = mni+i,ki = m„2) and k2 = run^+i, for some 1 < ni < n2 < n2 -|- 1 < n. If 
ni < n2 then we let £2 = {£1 U {Ejk, Ej^j,Ejj^,Ek^k, Ekki}) \ {Ejij2, Ek^ki}- If = n2 then we let 
£2 = {£1 U {E'.^, E'^^, Ej^j, Ekj,}) \ {Ej^j^}- We add ^2 = (V2, ^2) to the family of NCC*-graphs. 

(iii) We will say that a sequence {Qj}i<j<k is a tower of NCC*-graphs if all graphs in the sequence 
are NCC* and for every j > I, Qj is constructed from Qj-i as in part (ii) of the definition. 



t:s25. 1 Theorem 2.9. (i) A TLG is an NCC-graph if and only if it is an NCC-graph. 
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(a) Every planar TLG is NCC. 

(in) There exists a non-planar NCC-graph. 

(iv) There exists a non- NCC- graph. 



Proof of Theorem^ (i) Step 1 (NCC =^ NCC). Suppose that an NCC-graph g = {V,£) is 
given. We will show how to construct it in an inductive way. 

We let Qi = (Vi,<Si) be the minimal graph with Vi = {io = Oj^at = 1} and £i = {Eqn}. Note 
that Qi is an NCC*-graph and we can find representations for Q and Qi such that C TZ{G). 

Suppose that an NCC*-graph = {Vk,£k) has been constructed and there exist representations 
such that TZ{Qk) C TZ{Q). Moreover, assume that if two edges Em^rn and Em2m belong to Qk then 
tm is the end of a forward- minimal cell in Q. We will prove that there exists an NCC*-graph 
Qk+i 7^ Qk^ such that TZ{Gk) C Tl{Qk+i) C TZ{G). We will construct Gk+i in such a way that if two 
edges Emim and Em2m belong to Qk+i then tm is the end of a forward-minimal cell in Q. Since G 
has a finite number of edges, we must have 1^(0 k+i) = ^(^) for some k, so all we have to do to 
finish the proof is to complete the inductive step. 

Suppose that Qf^ ^ Q. There exists t„ G TliGk) such that tn £ V \ Vfc and Enm 't- T^iGk) for 
some m, because there is at least one edge in TZ{G) \ Tl{Gk) that is connected to Tl{Qk), and it is 
impossible for all such edges to leave TZ{Gk) in the negative direction. Let tj-^ be the largest tn with 
this property. Let tj* be defined as in Definition ti.6 (iv), relative to Q. 

Case (a). Suppose that tj* £ TZ{Qk)- Then there exists a time path ai = a{qo, qi, . . . , Qm) in ^, 
with qo = ji, qn^ = jf, and Eg^g^ ^ Ti{Qk)- 

We will now show that ai does not intersect IZiQk)-, except for its endpoints. Suppose otherwise. 
Then ai intersects TZ{Gk) at some tm such that tj-^ < tm < tj*, and for some tmi, we have Emmi S 
and Emmi T^{Gk)- Let tm2 be the largest tm with these properties. Thentm2 £ TliQk)-, G V\Vfc 
and Em2m3 't- T^{Gk) for some m^. Since tj-^ < tm2, this contradicts the definition of tj-^. 

We add {{t, Eq^q^_^^-^{t)),0 < r < ni — l,t G [ig,.) ^5^+1]} to TZ{Qk) and we let this new set to be 
the representation of Gk+i- 

We have assumed that if two edges Emim and Em2m belong to Qk then tm is the end of a 
forward- minimal cell in Q. This implies that tj* cannot be a vertex of Gk because it is the end of a 
forward- minimal cell in G which is not in Gk, and the assumption that G is NCC implies that there 
are no two forward- minimal cells in G with the same endpoint. 

The TLG Gk+i is an NCC*-graph because it was constructed from an NCC*-graph as in Definition 
ETS (11). It is clear that TZ[Gk+i) C TZ[G). Since tj* is the end of a forward-minimal cell in G, all 



vertices in Gk+i satisfy the property that if two edges Em^m and Em2m belong to Gk+i then tm is 
the end of a forward- minimal cell in G- 

Case (b). Next suppose that tj* ^ TZ{Gk)- The vertex tj* is the end of a cell (173,(74) in G, with 
the start at ij^. Since tj-^ £ TZ{Gk)i one and only one of the time paths (J3 and 174 (say, 173) has an 
edge -Ejij'a that belongs to TZ{Gk)- Let Ej^j^ be the first edge in CJ3 that does not belong to TZ{Gk)- 
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Then tj^ £ TZiQk), tj^ £ V \ Vk and Ej^j^ ^ 7^(^fc). Since tj,^ > tj^, this contradicts the definition 
of tj-^. Hence, it cannot happen that tj* ^ TZ{Qig). 

This completes the proof of the inductive step and shows that NCC-graphs are NCC*-graphs. 

Step 2 (NCC =^ NCC). The proof will be inductive. The minimal graph Q = (V,<?), with 
V = {to = OjtAT = 1} and £ = {Eqn}-, is an NCC*-graph and it is also an NCC-graph. 

In Definition &TS, new graphs in the family of NCC*-graphs are created from other graphs in 



the same family. Suppose that Qi is the minimal graph defined above, and (^i, 02, ... , Gm) is any 
tower of NCC*-graphs. Suppose that a vertex is added to Qn-i so that Qn is the first graph 
in the sequence that has the vertex t^. Suppose that is the end of a cell. We will show that 
tk is the end of only one forward-minimal cell in and that it will not be the end of any other 
forward- minimal cell in any graph Qm for n <m < M. 

Note that the definitions of NCC*-graphs and NCC-graphs are invariant under time reversal, 
so the analysis of forward-minimal cells can be applied to backward-minimal cells. Hence, we will 
limit our argument to forward-minimal cells. 

ilfipf.: Ind 



Let us recall the construction given in Definition ETS (n). Suppose that Qn-i = (Vn-i,<?n-i) is 



NCC*, where Vn-i = {^Oi ii-, ■ ■ ■ , ^Af}- There exist tj, ^ Vn-i, tj < t^ such that Ej^j^, Ej.^^^ G £i 
for some tj^ < tj < tj^ and t^i < tfc < tfcz- We have Gn = (V„,<f^n), Vn = Vn-i U {tj,tk}. 
There exists a time path a{mi,m2, ■ ■ ■ ,mn) such that ji = m„^,j2 = m„^+i,A;i = m„2, and 
k2 = m„2+i, for some 1 < ni < n2 < 71-2 + 1 < n. There are two possible cases, (a) If rii < n2 
then £2 = {£1 U {Ejk,Ejj^j,Ejj2,Ek^k,Ekk2}) \ {Ej^j^.Ek-^ki}- (b) If ni = n2 then £2 = {£1 U 

First we will show that t^ is the end of only one forward- minimal cell in Qn- In case (b), it is 
obvious that there is only one cell {{E'-f^}^{E'-^}) that is forward-minimal and has the end at tk- 
Consider case (a) and let ai = a{j, . . . , m„,2, k). The cell (ci, {Ejk}) is forward-minimal and 

has the end at tk- Suppose that some other cell ((T2, cjs) in Qn has tk as its end, and call its start tr- 
Then one of the time paths CJ2 or (say, (T2) must pass through tj, and the other one, (T3, must 
pass through . Recall that cJi is a time path that goes through tj and . Let the concatenation 
of the part of (72 between t^ and tj and the part of cJi between tj and tk^ be called 174. The time 
path o"4 starts at tr with an edge different from the first edge of (T3. The paths (T3 and (74 contain 
tk^ so a forward-minimal cell with start tr must have the end at or an earlier time. Therefore, 
it cannot have the end at tk > tk^- 

Next we will show that tk cannot be the end of two forward-minimal cells in any graph Q^n, 
m > n- Suppose to the contrary that tk is the end of two different forward-minimal cells in 
Gq for some q > n but it is not the end of two different forward- minimal cells in Qrn, m < q- 
Recall that, according to our construction, tk = tj*, that is, when we added tk to the set of 
vertices, we also created a forward- minimal cell with start tj and end tk- Suppose that Qq was 
constructed by adding an edge Ei^^g^ to Gq-i and this procedure created a new forward-minimal cell 
(o-i,o-2) = . . - ,qsi,k),a{ri, . . . ,rs2,k)) in Qg with qi = n ^ j- The edge Ei^^g^ must belong to 
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Figure 2. A non-NCC-graph f ig2 

one of the time paths in this cell, say, ii = g^g, £2 = Qss+i and Qss+i 7^ k. According to Definition 
BTS (n), Gq-i must contain either a time path (T(gs3_i,ui, . . . ,1x^4, ^53+2) or 17(553-1, 953+2)- Then 



Gg^i contains the cell ia{qi, . . . ,933-1, "Ui, • • •, ""54, 9^3+2, • ■ ■ ,qsi,k),a{ri, . . . , r^j. A;)), possibly with 
til , ... , missing in the first path. If this is a forward-minimal cell then this contradicts the 
assumption that there is only one forward-minimal cell in Gq-i with end tk- If this cell is not 
forward- minimal then ql, defined as in Definition b.6 (iv) satisfies q^ < k, relative to Gq-i. This 



implies that 9* < k, relative to Gq, which contradicts the assumption that ((Ti,(72) is a forward 
minimal cell. This completes the proof of part (i). 

(ii) It is easy to see that if a TLG G is planar then the region enclosed by TZ{G) is divided by 
TZ{G) into non-intersecting cells that are both forward-minimal and backward-minimal. Therefore 
every vertex, except to and ^Af, is either the start or the end of a single cell that is forward-minimal 
and backward-minimal. 

(ifi) Let G = (V, £), where V = {tj = j/7,j = 0, 1, . . . , 7} and 

£ = {-E'0,1, -E'1,2, -£^2,3, -E'3,4, -£'4,5, -^5,6, -£'6,7, -£-1,4, -^2,5, E^fi}- 

It is elementary to check that G is an NCC-graph and it is not planar. See Fig. |T 
(iv) Let G = (V, £), where V = {tj = j/7, j = 0, 1, . . . , 7} and 

£ = {-£'0,1, -E'1,2, -£^1,3, -£^2,4, -£^2,5, -£"3,4, -£'3,5, -£-4,6, -£'5,6, E^j}- 

The cells ((t(3, 4, 6), cj(3, 5, 6)) and (cr(2, 5, 6), (7(2, 4, 6)) are minimal and co-terminal. Hence, G is 

J£iK2 

not an NCC-graph. See Fig. 
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U t, h 



Figure 3. An NCC-graph that contains a non-NCC-graph f ig4 

□ 

Remark 2.10. The analysis of NNC-graphs is somewhat complicated due to the following facts. 

(i) If Qi and Q2 are NCC-graphs and TZ{Gi) C 1Z{Q2) then it does not necessarily follow that 

Qi and Q2 belong to a tower of NCC-graphs. For example let Qi be obtained from the graph in 

Fig. [ij'^Sy removing £'34 and £"26) and let Q2 be obtained from the graph in Fig. [if^Sy removing £34. 

ppf : ind 

Adding £25 to Qi does not conform to the rules of Definition BTS 



(ii) It is quite obvious that there exist TLG's Qi and Q2 such that TZ{Qi) C TZ{Q2)-, Gi is NCC 
and Q2 is not NCC. For example, take Qi to be a single full path and Q2 to be the graph in Fig. 
It is less obvious that there exist TLG's Qi and Q2 such that 7l{Qi) C 71(02), Q2 is NCC and Qi 
is not NCC. For example, let Q2 be the graph in Fig. [if^To see that Q2 is NCC, note that one 

Jfipf .: Ind 



can construct it as in Definition E75 by starting with the full path cr(to) ^5) ^6) ^lOi ^ii) and 



adding edges in this order: (T(ti, t2, ^3, ^4), o-(i3,i6), o-(*7, ^9, *io), (^{h,t8), CFih^h)- Let Qi be 
the graph obtained by removing £34 and £78 from Q2. The graph Qi is topologically the same as 
that in Fig. [§f^so it is non-NCC. 

We will extend the definition of TLG's to graphs with infinitely many vertices. First, we present 
two simple generalizations of TLG's with finite V. It will be convenient to allow TLG's (with 
finitely many vertices) in which to and t^^ take values in M U {—00,00} with the restriction that 

< iN- Clearly, all theorems proved so far apply to thus enlarged family of TLG's. Note that 
allowing to and to take infinite values does not add anything significant to the model because 
we can rescale the graph by the deterministic function t — )• arctant. We allow for infinite values of 
to and tiv to be able to study standard examples of Markov processes on the real line. 

m27. 1 Definition 2.11. (i) Suppose that the vertex set of a graph Q = (V, £) is infinite. We will call Q a 
time-like graph (TLG) if it satisfies the following conditions, (a) There exists a sequence of TLG's 
Qn = (Vn,<?n)5 ?^ > 1, such that each Vn is finite, and for some representations of QnS and Q we 
have TZ{Qn) C TZ{Qn+i) for every n, and Un^(^") ~ T^iQ)- (b) The graph Q is locally finite^ i.e., 
it has a representation 'R-{Q) C such that for any compact set K C M'^, only a finite number of 
edges intersect K. 
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(ii) We will call a TLG G with infinite vertex set an NCC-graph if it satisfies the following 
conditions, (a) The sequence {Gn}n>i in part (i) of the definition can be chosen so that it is a 
tower of NCC-graphs in the sense of Definition '^S fnf). (b) Let V„, = {to,n,ii,n, • • • ,tN„,n}- The 



initial vertices to,n S V„ and terminal vertices tAr„,n £ V„ are the same for all Qm i-e., to,n = to,m 
and tN„,n = tNm,,m for all n and m. (c) The initial edges form a decreasing sequence, i.e., Eto „^ti.„ C 
^tom,tim n > m. Similarly, terminal edges form a decreasing sequence, i.e., E{t]y^-i^nitN„,n) C 
E{tNm-l,m,tNm,m) if n > m. 

Remark 2.12. It is easy to see that \i Q = (V,iS) is a TLG with infinite number of vertices then all 
vertices have degree 3, except for at most two vertices with degree 1. 



3. Markov processes on time-like graphs 

Suppose that Q = (V,<?) is a TLG and V is finite. Let V denote the distribution of a Markov 
process {Y{t),t G [^Oj^Af]}- We do not assume that the Markov process is necessarily time- 
homogeneous, i.e., that its transition probabilities are invariant under time shifts. 

The regular conditional distribution of {Y{t),t E [^1,^2]} given {Y{ti) = ^1,^(^2) = ^2} exists for 
"P-almost all values of (y(ti), Y{t2)), under mild assumptions on the state space of Y] see Sect. 21.4 
in ^ for a discussion of conditional probabilities. The conditional distribution of {Y[t),t G [ii, ^2]} 
given \Y{ti) = yi,Y{t2) = 1/2} will be called a Markov bridge. The Markov bridge is a (time- 
inhomogeneous) Markov process on the interval [ti,t2]- 

Definition 3.1. Let X be a collection of random variables Xjk{t), for all Ejk G £ and t £ [tj,tk]- 
If Ejk,Ekn G S then we assume that Xjk{tk) = Xkn{tk), and similarly, if Ejk,Enk & ^ then 

Xjk{tk) = Xnk{tk)- 

Recall that we may have two edges E"^-^ and E'^j^ with the same endpoints tj and tk- Then the 
collection of random variables Xjk{t) contains separate families {Xjj^{t),t £ [tj,tk]} and {Xjj^{t),t £ 
[tj,tk]} corresponding to each edge. 

Consider a time path ai = a{ki,k2, ■■■,kn) and let Xa^{t) = Xki,k2,...,k„it) = Xk^^kj+^t) for all 
j = 1, 2, . . . , n — 1 and t G [tk^ , ifc^+J • We will call X a V -process on Q if for every full time path a, 
the process {Xfj{t),t G [ioi^Af]} has distribution V. We will write X{t) instead of Xjk{t) or Xo-(t) 
when no confusion may arise. 

We extend the notion of a "P-process on a TLG (with finite V) to processes that are defined for 
all t £ E, E £ £, except to and t^. For example, we can take Iq = —00, = 00 and let V be the 
distribution of a two-sided Brownian motion conditioned to have value at time 0. This extension 
does not pose any technical problems but allows us to consider natural examples. 

Note that if X is a 7^-process and ai = a{ki, k2, ■ ■ ■ , kn) then conditionally on X{tkj) = Xj, 
1 < J < J^, the path {X{t),t £ ai} has the same distribution as the concatenation of independent 
Markov bridges from {tk^,X{tk^)) to (tfc^+i, ^(tfc^+J), 1 < j < n. 
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For every TLG Q and every V, there exists a P-process on Q. A trivial example of a P-process 
on a TLG can be constructed by taking a Markov process {Y{t),t G [to,tAr]} with distribution V 
and then letting Xj^it) = Y{t) for all Ej^ G £ and t G \tj,tk\- 

in23 ■ 1 Definition 3.2. Suppose that W C TliQ) is a finite non-empty set such that 'Tl{G) \ W is discon- 
nected. Some edges of Q are cut by W into two or more sub-edges; let us call this new collection 
of edges £q. Suppose that £\ and £2 are disjoint sets of edges with the union equal to £q. Each 
set £\ and £2 may consist of several connected components of 'R-{G) \ W. We will call a process 
X on a TLG Q a graph- Markovian process if for all W,£i and £2, the conditional distribution of 
{X{t), teE,E e£i} given {X{t), teE,E e£2} depends only on {X{t),t G W}. 

m23.2 Definition 3.3. For a point t in G, let F{t) ("the future of f ) be the set of all points s > t such 
that there is a full path passing through t and s. Similarly, let P(t) ("the past of t") be the set of 
all points s < t such that there is a full path passing through t and s. We will say that a process 
X on a TLG Q is time- Markovian if for every t, the conditional distributions of {X{s),s G F(t)} 
and {X{s),s G P{t)} given X{t) are independent. 

m22. 1 Remark 3.4. (i) Suppose that a process X on a TLG Q is time-Markovian and s and t lie on a full 
path a, with s < t. It is easy to see that the conditional distributions of {X{u), s < u < t,u £ a}, 
{X{u),u G F{t)} and {X(u),u G Pis)} given X{s) and X{t) are jointly independent. Moreover, 
the conditional distribution of {X{u),s < u < t,u £ a} given X(s) and X{t) is that of a Markov 
bridge between {s,X{,s)) and {t,X{t)). 

(ii) It is easy to sec that if a process X on a TLG Q is graph-Markovian then the families of 
random variables {X{t),t G E}, E £ £, are conditionally independent given {X{t),t G V}, and 
for every Ej^ G £, the conditional distribution of {X(t),t G Ejk} given {X{t),t G V} is a Markov 
bridge between {tj,X{tj)) and {tk,X{tk)). 

Definition 3.5. We will say that a P-process X on a TLG Q with finite vertex set V is natural if 
it is time-Markovian and graph-Markovian. 

Recall that we call a cell {a{ji,j2,---,jni),(^iki,k2,---,kn2)) simple if there is no time path 
a{mi,m2, ■ ■ ■ , run^) such that we have mi G {j2, ■ ■ ■ , Jm-i} and m„3 G {k2, ■ ■ ■ , kn2-i}, or mi G 
{k2, . . . , kn2-i} and mng G {^2, ■ ■ • Jm-i}- 

Definition 3.6. We will say that a process X on a TLG Q is cell- Markovian if for any simple cell 
consisting of cr(ji,j2, • • • ,ini) and (7(/ei, ^2, . . . , A:^^, the processes {Xj^ j2,...j„Jt), t G [tji,tj„J} and 
{Xki^k2,...,kr,^{t)i't G [*fei,ifc„J} are conditionally independent, given the values of Xj^,i2,.-,ini 
and Xjij2,...j„^(tj„J (these are the same as Xk^^k2,...,K^{tkr) and Xk^M^-.K^i^K^))- 

Note that there is no direct logical relation between the notions of time-Markovian, graph- 
Markovian and cell-Markovian processes. 
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th:nat Theorem 3.7. (i) For every NCC-graph Q with finite vertex set V and every Markov process V , 
there exists a natural V-process X on Q , and the distribution of such a process is unique. The 
natural V-process is cell-Markovian. 

(a) Suppose that for some TLGQ with V = {t^ = 0, ti, . . . , t^v = 1}, there exist simple coterminal 
cells (cTi,(T2) with endpoints ti < t2, and (ct3,ct4) with endpoints t^ < t4^. Assume that either ti < t^ 
or t2 < t4. Then there is no natural Brownian motion on Q. 



1 . Pryat 

m25 . 1 Remark 3.8. (i) Part (ii) of Theorem BT7 cannot be generalized to say that "Then there is no natural 



Markov process on The reason is that the process identically equal to is a natural Markov 
processes on every TLG. There are also less trivial examples. 

(ii) If we take t2 = 3/7 instead of 2/7 in Figure [ij^^hen we will have an example of a TLG with 
coterminal cells for which neither ti < ts nor t2 < t^ holds. The starts t2 and ts of the two cells 
correspond to the same time 3/7. 

(iii) If Qi C G2, both graphs are NCC, X is a natural "P-process on Qi and X' is a natural 
P-process on Q2 then it is not necessarily true that the distribution of X is that of X' restricted 
to Gi. To see this, let V be the distribution of Brownian motion, Q2 be the graph in Fig. |§f^and 
let Qi be the graph obtained by deleting the edges E3q,E23 and £'34. One can check that the 
joint distribution of (X(t2), ^(^4)) is different from that of {X'{t2),X'{t4^)). This can be shown by 



applying Proposition Et to {X {t2) , X (ti)) . To determine the distribution of {X' {t2), X' (t/j^)), note 



that t2 and t^ lie on a full time path in Q2- 

(iv) Suppose that an NCC-graph G is the last element of a tower of NNC-graphs {Gk}i<k<n- 

Then the restriction of a natural process X on ^ to any Qj, 1 < j < n, is a natural process on Qj. 

J t'-ii • n at 

This follows from the proof of Theorem Ei. Y Below and from the uniqueness of the natural P-process. 

■ P^,aF "^ 

(v) Does uniqueness in Theorem tJTT "(IJ hold true if we replace "natural" with "graph-Markovian" ? 



We leave this as an open problem. 

■ tttoiat 

We will prove part (i) of Theorem bTT m this section and part (ii) in the next section. 



Proof of Theorem W7J~(T). We assume that V is finite, to = and t^ = 1. Fix any Markov process 
distribution V. We will use induction, since according to Theorem ti.9 the family of all NCC-graphs 

: ind 

can be constructed inductively, as in Definition BTB 



It is obvious that there exists a unique in law natural 'P-process on the minimal graph Q = (V, £), 
with V = {ti = 0,tN = 1} and £ = {Eij\f}. It is also easy to see that this process is cell-Markovian. 

Suppose that Qi is an NCC-graph. We make the inductive assumption that there exists a natural 
P-process X on Qi, it is unique in law and it is cell-Markovian. 



ind 



Recall how a new graph Q2 is constructed in part (ii) of Definition BT5 Suppose that Gi = (Vi, iSi 



with Vi = {ti,t2, ■ . ■ ,t]\f}. Suppose that tj,tk ^ Vi, tj < tk, and for some Ej^j^,Ek^k2 ^ ^i-, we 
have tjj < tj < tj^ and tk-^ < t^ < t^^- Let V2 = Vi U {tj,tk}. Assume that there exists a time path 
a{mi,m2, ■ ■ ■ ,rnn) such that ji = m„j,j2 = m„j+i,A;i = m„2, and k2 = mnj+i, for some 1 < ni < 
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n2 <n2 + l <n. (a) If ni < n2 then we let £2 = {£1 U {Ejk, Ej^j, Ejj^^E^-^^, ^^fete}) \ {^jij2^ Ekik2}- 
(b) If m = ns then we let £2 = {£1 U {E'-^, E]^, Ej^j, EkjJ) \ {Ej^j^}. Then 02 = (V2, £2). 

It will suffice to show that there exists a natural P-process X on ^2, it is unique in law and it is 
cell-Markovian. 

In case (a), we effectively add only one edge Ejk to graph Qi. Other "new" edges Ej^j,Ejj^, E^^k 
and -Bfc/fcj arc created by subdividing Ej-^^j^ and Ek^j.,^. Let Zi = Xj^j^{tj) and Z2 = Xfc^fc2 (^A;)- 
We define {X'-^{t)^t € [ij,ife]} to be a Markov bridge between {tj,Zi) and (^^,^2), otherwise 
independent of {X{t),t € Qi}. In other words, Xji^{tj) = Zi, X'-^{tk) = Z2, and the distribution of 
{X'-j^{t),t G [tj,tfc]} is the same as that of the process {Y{t),t G [tj-,tk]} under conditioned by 
Y{tj) = Z\ and Yiik) = ■^2- We define a process X' on TLG Q2 by letting it have the same values 
as X on 7^(^i), and using the above definition on Ejk- 

In case (b), we add two edges E'^^ and E"^^ to Q\. The other new edges Ej^j and Ekj^ are created 
by subdividing Ej^j^. Let Z\ = Xj^j^{tj) and Z2 = Xj-^j^{tk)- We define {X'-^{t),t G [ijjife]} 
and {X'-j^{t)^t G [tj,tjt]} to be independent Markov bridges between {tj,Zi) and {tk,Z2), otherwise 
independent of {X{t),t G Qi}. We choose the representations Tl{Qi) and Tl{Q2) so that they agree 
on Tl{Qi) with the part of Ej^^j^ between tj and tk removed. We define a process X' on TLG Q2 
by first letting it have the same values as X on Tl{Qi) \ Ejk- The process {Xjf,{t),t G 
represents the values of X' on the edge Ejj^ and {Xjf,{t),t G [ij,ife]} represents the values of X' on 
the edge Ejj^. 

In the rest of the proof, we will focus on case (a) . Case (b) requires minor modifications and is 
left to the reader. 

Recall that Qi contains a time path a{mi,m2, ■ ■ ■ ,mn) with ji = 32 = fn^j^iiki = 

m„2, and /c2 = w.n2+i) for some rii < n2- This implies that G2 must contain a time path 
a{mi, . . . ,ji,j,j2, ■ ■ ■ , ki, k,k2, ■ ■ ■ , m,n)- There is a Markov bridge between (tj, Zi) and {tk, Z2) 
in the representation TZ{Qi). The construction of {Xjj^{t),t G consists of generating an in- 

dependent Markov bridge between the same points. By the Markov property of V, the distribution 
of Xj^ ■ ^ on the graph Q2 is the same as the distribution of Xj^j^^^^^^ki,k2 the graph Qi. This im- 
plies that for every full path a{ri, . . k, k2, ■ ■ ■ ,rn) in Q2, the distribution of X'^^^ -^ - f^ f,^^ 
is V. Hence, X' is a T'-process on Q2. 

Next we will show that X' is cell-Markovian. Consider a simple cell (o"i, 0-2) in Q2- Suppose that 
the paths ai and a2 do not contain the new edge Ejk- Then (cri,(T2) is a simple cell in Qi. By 
the inductive assumption, the processes X on cri and X on (J2 are conditionally independent given 
their values at the end and start of the cell. Since X' is equal to X on {a\,a2), the same claim 
holds for X'. 

Now consider a simple cell {(Ji,(J2) in Q2 such that cji contains Ejk- Then we have cri = 
C7(ri, . . . , ji, j, k,k2,..., r„J and (72 = a{qi, q^^). We will show that processes X'^^^ 
and ^5i,...,5„2 are conditionally independent given their values at the start and end. 
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First, we will argue that the cell consisting of time paths = a{ri, . . . , ji, j2, ■ ■ ■ , ki, k2, ■ ■ ■ , r„j) 
and (74 = a{qi, . . . jQn^) is simple in Qi. Suppose otherwise, i.e., there exists a time path = 
cr{si, . . . , Sng) in Qi which connects 0-3 and (T4. We will consider several cases. If si G {r2, . . . , ji} and 
s„3 G {q2, • • • , qn2-i} then 175 connects ai and (T2 in a contradiction. We arrive at a contradiction 
for a similar reason if we assume that si E {A;2, . . . , ^'m-i} and Sng G {q2, ■ ■ ■ , Qn2~i}'^ if we assume 
that si e {^2, • • ■,qn2-i} and s„3 € {r2, . . . , ji}; or si G {92, • • • ,Qn2-i} and s„3 e {A;2, • • . ,r„^-i}. 
Next suppose that si G {j2, . . . , /^i} and s^g € {(72, • • • > Q'n2-i}- Let (Tg = . . . si) be the sub- 
path of (T3. Then the concatenation of and connects ai and ct2 in ^2) a contradiction once 
again. Finally, suppose that si G {^2, • • ■ , 9n2-i} and G {j2, . . . , /ci}. Let cry = a{sn3, . . . ki) 
be the sub-path of a^. Then the concatenation of and cry connects ui and (T2 in ^2) which is a 
contradiction. 

By the inductive assumption, j2,...,fc^,A,.2,...,r„^ and X^j^ ..^^^^ are conditionally independent 

given the values at the start and end of the corresponding cell. This and the Markov property 
imply that the process {Xri,...,ji j2,.--,'ti,fc2,.--,rni ^ ^ [^jj^fe]} is conditionally independent from 
the processes {Xri,...,ji ,j2v:'=iifc2v,»'ni (0' ^ ^ [^ru^rn-^] \ [^jj^fc]} and Xg-^ _ q^^ given the values of 
Xri,...,ji,j2,-,ki,k2,-,rn^itj) ^^'^ Xri,...,ji,j2,-M,k2,-,rn^i^k) ■ The claim remains valid if we replace 
{-'^ri,... ,ji,j2,---,fci,fc2,---,r-ni (^)i * ^ [^jj^fc]} with {Xji^{t),t £ [tj,tk]}, and this in turn shows that the 
joint distribution of X;^i,„.j, fc,^^,...,^^^ and X'g^ ^^^ is the same as that of X^i,... ,j2,...,fci,fc2,...,r„i 
and X<ji,...,g„2 • Hence, X'^_^ ji j k k2 t-„ ■^qi,...,q„^ conditionally independent given their 

values at the start and end. We have shown that X' is cell- Mar kovian. 

Next we will show that X' is time-Markovian. Suppose that t ^ Eji^.. If F{t) and P{t) in Q2 

are the same as F(t) and P{t) in Qi then the time-Markov property obviously holds for t in Q2- 

Suppose that the future F2{t) of t in Q2 is the union of the future F{t) of t in Qi and Ejk- Since 

{X'{t),t £ Ejk} is the Markov bridge between {tj,X{tj)) and {tk,X{tk)) otherwise independent of 

{X'{t),t G £^2 \ ^i}) and, by the inductive assumption, {X{s),s G F{t)} and {X{s),s G P{t)} are 

conditionally independent given X{t), it follows easily that {X'{s), s G -^2(^)1 and {X'{s), s G P{t)} 

are conditionally independent given X'(t). A similar argument applies when the past P2{t) of t in 

Q2 is the union of the past P{t) of t in Qi and E'jfc. 

Consider the case when t G Ej^. Let o" be a full path disjoint from Ejk except for tj and tk- By 
■n22,. 1 



Remark BT?^he conditional distributions of {X{u),tj < u < tk,u £ a}, {X{u),u G F{tk)} and 
G P{tj)} are independent given X{tj) and X{tk). Moreover, the conditional distribution 
of {X{u),tj < u < tk,u £ a} is that of a Markov bridge between {tj,X{tj)) and (tk, X{tk)). This 
and the fact that {X'(t), t G -Ejfc} is the Markov bridge between (tj, X{tj)) and (tk, X{tk)) otherwise 
independent of {X'{t),t G £2\£i} imply that the joint distribution of {X{u),tj < u < tk,u £ Ejk}, 
{X{u),u £ F{tk)} and {X{u),u £ P{tj)} is the same as the joint distribution of {X{u),tj < u < 
tk,u £ a}, {X{u),u £ F{tk)} and {X{u),u £ P{tj)}. By the inductive assumption, the time- 
Markovian property holds for X, Qi and the point t^, £ a with the same time coordinate as t, so 
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we conclude that the time-Mar kovian property holds for X' , Q2 and t. This completes the proof of 
the time-Markovian property for X' . 

We will now show that X' is graph-Markovian. Suppose that W C TZ{Q2) is finite and Eq^Ei and 

J m23..1 

E2 are as in Definition BT2Tjet W* = W ^^^Z{Ql), and, assuming that W* 7^ 0, let En,El and E2 be 
' ' )n9.^ 1 

defined relative to ^1 as in Definition |l3.2[ By the induction assumption, the conditional distribution 
of {X'{t),t e E,E e E^} given {X'{t),t £ E,E e E^} depends only on {X'{t),t £ W*}. Since 
{X'{t), t € Eji^} is a Markov bridge between tj and t^, independent of the values of X' except for 
X'{tj) and X'{tk), it is easy to see that the conditional distribution of {X{t),t G E,E £ Ei} given 
{X{t),t £ E,E G E2} depends only on {X{t),t £ W}. If W* = 0, the same conclusion is also 
evident. Hence, G2 is graph-Markovian. 

It remains to prove uniqueness in law of a natural P-process on an NCC-graph. Once again, we 
use induction. The distribution of a natural P-process on the "minimal" graph described above is 
obviously unique. Suppose that we have shown uniqueness in law for natural P-processes on all 
NCC-graphs with the number of edges equal to 1 + 3r or less. Any NCC-graph O2 = 0^2, E2) with 
l + 3(r + l) edges can be constructed from an NCC-graph Qi = {Vi,Ei) with l + 3r edges by adding 
an edge, say Ejk, as in Definition \2.S (11). Consider a natural "P-process X on Q2- Its restriction 
X to Gi is a "P-process. We will argue that X is a natural P-process on Gi. 

First, we will prove that X on Gi is time-Markovian. Consider any point t in Gi and let Fi{t) and 
Pi{t) be the future and past of t relative to Gi, defined as in Definition ^^Tjet F2{t) and P2{t) be the 
future and past of t relative to G2 and note that Fi(t) C F2{t) and Pi{t) C P2{'t)- Since X' on G2 is 
assumed to be natural, the conditional distributions of {X'(s), s G F2{t)} and s € P2{f)} are 

independent given X'{t). This clearly implies that the conditional distributions of s G Fi[t)} 

and {X{s),s G Pi{t)} are independent given X{t). We see that X on Gi is time-Markovian. 

Next we will show that X is graph-Markovian on Gi- Let W C TZ{Gi) be as in Definition ^2 



1 



and let Ei and E2 play the roles of Ei and f 2 in the same definition (in this proof, Ei and E2 denote 
the sets of edges of Gi and ^2)- Since X' is natural, the conditional distribution of {X'{t),t £ -Ejfc} 
given {X'{t),t £ E,E £ E2\{Ejk}} is that of a Markov bridge between {tj,X'{tj)) and {tk,X'{tk)). 
For future reference, let us call this property (A). 

Suppose that tj £ Ei,tk £ E2 for some Ei,E2 £ Ei, tj,tk ^ W and let Ei = EiU {Ejk}- We 
have assumed that X' is graph-Markovian so the conditional distribution of {X'{t), t £ E, E £ Ei} 
given {X'{t),t £ E,E £ E2} depends only on {X'{t),t £ W}. This and (A) easily imply that the 
conditional distribution of {X{t),t £ E,E £ Ei} given {X{t),t £ E,E £ E2} depends only on 
{X{t),t£ W}. 

The same argument applies when tj £ Ei^t^ £ E2 for some Ei,E2 £ Ei, tj ^ W and G W, 
and also in the case when tj £ Ei,tk £ E2 for some Ei,E2 £ Ei, tj £ W and tk ^ W. 

Consider the case when tj £ Ei,tk £ E2 for some Ei,E2 £ E2 and let <?2 = '^2 U {Ejk}- We 
have assumed that X' is graph-Markovian so the conditional distribution of {X'{t),t £ E , E £ Ei} 
given {X'{t),t £ E,E £ E2} depends only on {X'{t),t £ W}. This and (A) easily imply that the 
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conditional distribution of {X{t),t G E,E G 61} given {X{t),t G E,E G 82} depends only on 

{X{t),tew}. 

Note that if t G W then t e Ei for some Ei G and t e E2 for some E2 E 82- Hence, the only 
case that remains to be analyzed is when tj G Ei,tk & E2 for some Ei € £i,E2 € £2, tj,tk ^ W. 
Since tj G Ei for some Ei G <?i, tj ^ W, and taking into account how Ejk was added to Qi, it follows 
that there exist Et-^_tj i Etj,t2 G such that ti, tj, t2, tk lie on a full time path ai. Since the process 
X' is natural, the conditional distributions of {X'{u),ti < u < t2,u ^ ai}, {X'{u),u G ^^(^2)} 
and {X'{u),u G P{ti)} arc independent given X'{ti) and X'{t2) and, moreover, the conditional 
distribution of {X'{u),ti < u < t2,u £ ai} given X'{ti) and X'{t2) is that of a Markov bridge 
between (ti,X'(ti)) and (^2, -^^'(^2))- We will need the following two facts in the next step of 
the argument. The first is property (A) defined above. The second is an application of the graph- 
Markovian property for X'. Let £3 be the union of all edges that comprises {u : ti < u < t2,u e ai}, 
F{t2), P{ti) and Ej)-. Let £4 be the union of all edges such that the union of £3 and £4 represents 
the whole graph Q2 and Wi is a finite set of points that £3 and £4 have in common. Note that 
tj,tk ^ Wi because all edges that end at these points belong to £3. By the graph-Markovian 
property of X' , the conditional distribution of {X'{t),t e E,E E £4} given {X'(t),t E E,E E £3} 
depends only on {X'{t),t G Wi}. 

Let Vi be the distribution of {X'{t),t G -P(ti) U ^(^2)}- Let 2^2(3^1, 2:2) be the conditional 
distribution of {X'{u),ti < u < t2,u £ ai} given {X'{ti) = xi,X'{t2) = X2}. Let ^^^{xj^xi^.) be 
the conditional distribution of {X'{u),u G Ejk} given {X'{tj) = Xj,X'(tk) = x^}. Let T>4{x) be 
the conditional distribution of {X'{u),u E E,E E £4} given the sequence x of values of X' at all 
points in Wi. 

Wc can construct a process Y on Q2 with the same distribution as X' as follows. First, define 
a process {Y(t),t G Piti) U F{t2)} with distribution T>i on some probability space. Then define a 
process {Y(u),u E E,E E £4} with distribution l?4(y), independent of {Y{t),t E P{ti) U F{t2)}, 
except that y is the already generated sequence of values of Y on Wi . Next define an independent 
(except for the endpoints) Markov bridge {Y{u),ti < u < t2,u E cJi} between {ti,Y{ti)) and 
{t2,Y{t2))- This process has distribution I?2(^(ii), ^(i2))- Finally define an independent (except 
for the endpoints) Markov bridge {Y{u)^u E Ej^} between {tj,Y{tj)) and {tk,Y{th)). This pro- 
cess has distribution V3{Y{tj),Y{tk))- It follows from our earlier remarks that Y has the same 
distribution as X' on Q2. The point of this construction is that it shows that given {Y{ti),Y{t2)}, 
the distribution of Y on P{ti) U F{t2) U £4 is independent of {Y{u),ti < u < t2,u E ai}. Hence, 
the distribution of X on P(ii) U -^"(^2) U £4 is independent of {X{u),ti < u < t2,u E ai} given 

{X{t^),X{t2)}. 

Let £^2 = ^2 U {Ejk}. Since X' is graph-Markovian, the conditional distribution of {X'(t),t E 
E,E E £2} given {X'{t),t E E,E E £1} depends only on {X'{t),t E WU {tj}}. It follows that 
the conditional distribution of {X{t),t E E,E E £2} given {X{t),t E E,E E £1} depends only on 
{X{t),t eWU {tj}}. Note that the values of {X{t),t E E,E E £1} include the values of X{ti) and 
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X{t2). Since the distribution of X on P{ti)UF{t2)u£4 is independent of {X{u), ti < u < t2,u £ ai} 
given {X (ti) , X (12)} , we conclude that the conditional distribution of {X{t),t £ E,E G £1} given 
{X{t),t £ E,E £ £2} depends only on {X{t),t G W}. This completes the discussion of the last 
remaining case of graph-Markovian property for X on Qi. 

By assumption, the families of random variables {X'{t),t G E'}, E E £2, are conditionally 
independent given {X'{t)^t £ V2}, and for every Ej^ £ £2, the conditional distribution of {X'{t),t £ 
Ejk} given {X'{t),t G V} is a Markov bridge between {tj,X'{tj)) and It is obvious 

that this implies that the analogous property holds for X on ^1. We have already shown that X is 
time-Markovian and graph-Markovian on Qi, so X is natural on Qi. By the induction assumption, 
X has a unique distribution. Rephrasing what we said earlier in this paragraph, for Ejk £ £2\£i, 
the conditional distribution of {X'{t),t £ Ej^} given {X'{t),t £ E,E £ £1} is a Markov bridge 
between {tj,X'{tj)) and {tk, X'(tk))- This determines the distribution of X' uniquely. □ 



Suppose that G = (V, £) is an NCC TLG and V is infinite. According to the definition of an 
NCC TLG with an infinite vertex set, there exists a tower of NCC-graphs Qn = {Vn,£n), n > 1, 
such that each V„ is finite, V = Un>i ^^"^ ^ — Un>i ^n- Let X„ be the natural 7^-process on Gn- 

■a25,. ' 



By Remark BTBllv), the restriction of X„ to Qk, for k < n, has the same distribution as that of X^. 
A routine application of Kolmogorov's consistency theorem shows that there exists a 7^-process X 
on G such that its restriction to any has the same distribution as that of X^. Note that the 
distribution of X may depend, in principle, on the sequence {Gn}- We will show that it does not 
if G is planar. We conjecture that the result holds for all NCC TLG's with infinite V. 



m25.3 Theorem 3.9. Suppose that G = (V,<S) is a planar NCC TLG and V is infinite. If X and X' are 

two V-processes on G constructed using two towers of NCC-graphs {Gn}n>i and {G'n}n>i then X 
and X' have the same distributions. 

Proof. Suppose that we can prove that for any Gj = {Vj,£j) and G'^ = O^'k^^k) there exist n > 
max(j, k) and graphs Tim, m = j + 1, . . . n, and Ti'^, m = k + 1, . . . ,n' such that = H'l C G and 
Gi, ■ ■ ■ , GjjT-Lj+i, • • • , T-Ln and G'l, - ■ ■ , G'j., ^fc+i) • • • 1 are towers of NCC-graphs. By Theorem B7 



| th :nat 



(i) and its proof, we can construct a natural process Y on Tin such that its restriction to Gj is X, 
and we can construct a natural process Y' on H'^, such that its restriction to G'f. is X'. By the 
uniqueness in distribution of the natural process on an NCC-graph, the distributions of Y and Y' 
are identical. Hence, the distributions of X and X' agree on n<S^. Letting j, k — )• 00, we conclude 
that the distributions of X and X' agree on £. 

It remains to prove that we can construct sequences {Tim} and {Ti'^} with the properties listed 
above. First suppose that the initial vertices io,n G Vn and t^ „ G and terminal vertices t7v„,n £ 
and t'j^^^^ £ are the same for aU Gn and G'n, i-e., to := *o,n = t'o,™ ^^^d too ■=tN„,n = t'Nm,m ^o"^ 
n and m. Assume also that the initial edges for both sequences overlap, i.e., Et^ ^^^ti „ C Ef-'^ ^/^ 
or K/ fi C Etn„u„ for all n and m. Similarly, assume that terminal edges overlap, i.e., 

O.m' l,m u,n: i,n 
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^(ijv„-i,n,«iv„,n) C E{t'^^_^^^,i!^^ J or ^(t'jv^_i,^,t'jv^,^) C E(ijv„-i,n,«iv„,n) for all n and m. 
Moreover, we assume that Qi = Q[ is the same full time path. 

Consider a (planar) representation Tl{G) of G and suppose that IZiQj) C and 7^(^fc) C 

TZ{Q). Recall that a representation of a planar graph is a set of points {t,x) G R^. It is easy to 
see that the upper boundary of TZ{Qj) is the graph of a continuous function fj : [to, too] — ^ I^j i-S-, 
= max{z : (t, z) € TZ{Qj)}. We similarly define relative to t?^, and let / = max(/,-, /^). We 
then define the lower boundary of lZ{Qj) as the graph of a continuous function gj : [to, ^oo] — ^ I^, i-e-, 
5j(t) = min{x : (t, x) G gr^ as the lower boundary of lZ{Q'j^ and g = min((7j, 51^). For any real 

functions a(t) and 6(t), let the graph lCa,b be defined by TZ{lCa,b) = {{t, x) G : a{t) < x < 5(t)}. 

Let nn = K' = ^f,9- 

Since Qj is an element of an infinite tower of graphs {Qm} such that Um>i^(^"i) = ^(^) 
and ^ is locally finite, we must have T^{}Cf.^g.) C TZ{Gnii) fo'^ some mi > j. Let Ei,E2, . . . ,Ejn2 
be edges added during the inductive construction of the tower {Gm}j<m<mi and such that their 
representations are in Tl{Qmi) \ '^{^fj,gj)i listed in the order in which they are added during 
the inductive construction. We construct a tower QjjT-Lj+i, . ■ ■ ,'Hj+m2 = ^fj,gj adding edges 
Ei,E2,..., Em2 in the same order (and no other edges). This construction can proceed according to 
the rules of the inductive construction of NCC graphs because edges Ei,E2,. . ., E^^ are shielded 
by the graphs of the functions fj and gj from all other edges added during the construction of 
{Qm}j<m<mi- We Construct a tower Q'k,'H'k^i, ■ ■ ■ ,'Hk+m3 = ^f'^,g'^. in an analogous way. 

It remains to define 'Hjj^m2+i-, ■ ■ ■ ,T~in- For future reference, we label the next part of the proof 
"Step (I)". If /fc(t) < fj{t) and (?^(t) > gj for all t then we let Hj+m2+i = T~i-j+m2- Otherwise, 
suppose without loss of generality that /^.(t) > fj{t) for some t. Let ti, t2, . . . , t„n be all vertices in 
the graph of fj such that there is an edge in T-Ln \ T~ij+m2 ending in t^., for r = 1, . . . , JTi4. The first 
such edge must go from ti forward in time and the last such edge must end in tmi- Hence, there 
must be a pair of vertices tr and t^+i such that there is an edge E^. in T-L^ \ T~Lj+m2 starting from t^ 
and an edge E'r+i (possibly the same edge) ending in t^+i. By the planarity of there must be a 
time path a from tr to t^+i in T-Ln containing E^ and E^+i- We add a (treated as a single edge) to 
'Hj+m2 8'nd thus obtain 'Hj+m2+i- 

If /j(.(t) > fj{t) and g'j^{t) < gj{t) for all t then we let 'H'j_^rn3+i — '^'j+m^- Otherwise, we generate 
'H'jj^rnz+i i^ ^ analogous to that used to construct Hj+m2+i- 

If /j(.(t) = fj{t) and 5fc(t) = gj{t) for all t then we let T-Ln = 'H'^, = 'Hj+m2- In this case, we are 
done. Otherwise, we have constructed towers of NCC-graphs 

Gi, ■ ■ ■ ,Gj, T-Lj+i , • • • , 'Hj+m2+i and Q[,...,Q'^, T~i'k+i ; • • • ) ^fe+ma+i 

such that either 'Hj+m2+i is strictly greater than Qj or ^^'k^m■i+l i® strictly greater than Q'j^, or both. 
Moreover, the TLG analogous to ICf^g but defined relative to Hj+rn2+i ^-nd T-L'i^_^_jj^^_^_i in place of Qj 
and Q'l^ is the same as ICf^g. 

We now proceed in an inductive way. Suppose that we constructed Tir^ and 'H'.^- Let 
represent the upper boundary of Tin , let /^^ represent the upper boundary of "H^^ > i^t g^ represent 
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the lower boundary of 11^ , and let g'^^ represent the lower boundary of 71'^.^ . We now repeat Step 
(I) with fj replaced by fr^ , /(. replaced by f^.^ , replaced by gr^ , and 5^ replaced by g'^.^ . This will 
generate towers 

^ij • ■ ■ , ^j, "Hj+i, . . . , ?^r-i+i and ^J, . . . , t/^j'H'^^i, . . . j'H^^+i- 

If Tiri+i = T~i'r2+i — = then we are done. Otherwise Tin+i is strictly greater than Tir^ or 
^rj+i is strictly greater than Ti'^,^, or both. The growth cannot continue forever because ICj^g has 
a finite number of edges, so eventually we will have Tin+i = ^'2+1 ~ ~ ^n'- 

Next we will argue that one can drop the assumption that t/i = ^[ is the same full time path (but 
we keep the assumption about overlapping of the initial edges and terminal edges of Gj^s and Q'f^^s). 
Suppose that TZ{Gi) U Tl{Gi) contains only one cell. Then the cell has no edges inside. Then the 
argument given above will work under this weakened assumption because Tl{T-Lj+m2) ^ ^(^fc+ma) 
will contain all edges between the graphs of / and g. 

A rather easy but tedious argument based on ideas used earlier in this proof shows that for any 
two graphs (full time paths) Gi and Q'l with initial edges and terminal edges overlapping there exists 
a sequence of graphs J'l = Gi, J2, ■ ■ ■ ■, Jq = Q\ such that TZ{Jr) U 7^(j7r+i) contains only one cell, 
for every r. This shows that X and X' have the same distributions if Qi and Q'^ have overlapping 
initial and terminal edges. 

Finally, we will show how to eliminate the assumption that the initial and terminal edges of Qi 
and Q[ are overlapping. Suppose that iS* C <S is a finite set and {Qn} and {Q'„} are two towers of 
NCC-graphs increasing to Q. Let ni be such that Tl{£^:) C TZ{Gni) ^ ^(^ni)- Let be a vertex 
such that t^: G V, G Tl{Qi), and t^: lies to the left of all the vertices in Vm and V^^, except the 
initial vertices. Note that there exists 712 so large that t* G V^^- This shows that there is a time 
path a' with the initial edge overlapping with the initial edge of Q[ and ending at . Let a be the 
initial part of Qi, between to and t^:. Let Q'^^ be the graph Q'^^ with a' replaced by a. Note that Q'^^ 
is an NCC-graph because we only changed the second coordinate of the representation of Q'^_^ for a 
part of the graph. Let X" be the natural process on Q'^^ . The distribution of X" on i5* is the same 
as that of X' because, once again, we only changed the second coordinate of the representation of 
for a part of the graph. We now modify the terminal part of to obtain an NCC-graph G'^'^ 
such that the initial and terminal edges of and Qm are overlapping. Let X'" be the natural 
process on The distribution of X'" on S^, is the same as that of X'. And this is the same 
distribution as the distribution of X on S^:, by the first part of the proof. Since £^ is an arbitrary 
finite subset of £, we see that X and X' have the same distributions. 

□ 



Definition 3.10. If ^ = {V,£) is an NCC TLG with infinite V and X is a process on Q with the 

b9.R.3 

distribution as in Theorem 16.91 then we will call X natural. 
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4. Brownian motion on time-like graphs 

In this section V refers to the distribution of standard Brownian motion. We wih consider a 
TLG with a finite vertex set V, to = and = 1. The 7^-process X on a TLG ^ is a mean zero 
Gaussian process so it is completely specified by its covariance structure. 

Proposition 4.1. // {a{jJni,---Jn2,kJn3,---,jn4,n),a{j,jn5,---Jne,rn,jnT,---,jns,ri)) is a 
simple cell of a TLG Q and X is a natural Brownian motion on Q then 



^ (^■^jjn-^,---Jn2,kj„^,...j„^,nitk)XjJ„^,...J„Q,m,jn^,...,jn^,nitm)^ — tj + 



(tn - t 



Proof. We will abbreviate X' = Xa a a i. „ and X" = Xa a i m i in- By the 

cell-Markovian property of the process, we can represent the joint distribution of X' and X" as 
follows. Let W and W be independent Brownian bridges on the interval [tj,tn]; in other words, 
W and W are independent Brownian motions conditioned by Wt^ = W^. = and Wt^ = W/^ = 0. 
Let a = {tk — tj)/{tn — tj) and /3 = {tm — tj)/{tn — tj). Then the conditional distribution of 
X'{tk) given {X'{tj) = Xj,X'{tn) = x„} is the same as the distribution of (1 — a)xj + ax„ + VFjj,. 
Moreover, the joint distribution of {X' (tk), X" (tm)) given {X'{tj) = Xj,X'{tn) = Xn} is the same 
as the distribution of ((1 — a)xj + ax„ + Wt^, (1 — I3)xj + + Wl^). Therefore, 

E {X'{tk)X"{trn) I X'{tj) = Xj,X"{tn) = X^) 

= E (((1 - a)xj + axn + Wt,)i{l - p)xj + + W'^J) 
= ((1 - a)xj + axn){{l - l3)xj + f3xn), 



and 



E {X'{tk)X"{t^)) = E (((1 - a)X\tj) + aX'{tn))i{l - P)X'{tj) + /3X'(t„))) 
= ((1 - a)(l - /3) + (1 - a)/3 + a(l - ^))tj + a/3t„ 
= (1 - a(3)tj + aj3tn = tj + a/3(tn - tj) 

{ik tj)(trn tj) , N {tk tj)(trn ^jf) 



{tn tj)"^ (tn tj) 

□ 



Proof of Theorem \37]~(vi). Suppose that for a TLG ^, there exist simple coterminal cells (o"i,o"2) 
with endpoints ti < t2, and {a3,ai) with endpoints ts < t^. Moreover, either ti < t^ or t2 < t^. 
Assume that there exists a natural Brownian motion X on Q. We will show that this assumption 
leads to a contradiction. 

We will assume without loss of generality that t2 < t^ and ti = t^. The first edge of cri, say, Ei^, 
must be the same as the first edge of as or the first edge of a^. Suppose without loss of generality 
that the first edge of ai is the same as the first edge of a^. Then the first edge of cr2, say Eim, is 



the same as the first edge of a^. Then we can use Proposition 47T to express the covariance of X 
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at vertices and tm- If we use the formula relative to the cell (ui, (T2) then the answer is 

, , {tk — tl){tm — tl) 

If we apply the same proposition relative to the cell (cj3,(T4) then we obtain a different answer, 

{tk — tl){tm — tl) 

This contradiction shows that there is no natural Brownian motion on Q. □ 



5. Graph martingales and Harnesses 



The previous computation of Brownian covariance in Section |^ 



c:BM 

can be extended to a class of 



processes called harnesses. This class of processes, which includes all integrable Levy processes and 
their bridges, was introduced originally by Hammersley ^[7 We follow the definition given in the 



article by Mansuy and Yor 

Definition 5.1. Suppose that T C M is a bounded or unbounded interval and let {H{t), t £ T} 
be an integrable process for all t whose sample paths are ROLL (right continuous with left limits) 
almost surely. Consider a past-future filtration {'Ht,T-, t <T; t,T £ T), with the property that 

a {H{s); s <t and s >T} cnt,T, and 'Ht^,T^ ^'Ht,T, ti <t < T <Ti. 

The process H is said to be a harness with respect to the filtration (Tit^T, t < T;t,T £ T) if, for 
all a < & < c < we have 

H{d) - H{a) 



d — a 



(5.1) eq:hness 



The equality in (^"^^i ) may also be reformulated as: H is a harness if and only if for all s < t < u, 
we get 



/ — S 11 — / 

E {H{t) I ns,u) = Hiu) + H{s). 



u — s 



(5.2) eq:hness2 



The following lemma establishes more path properties. 



propharness 



Lemma 5.2. Let {Y{t), t £ [0, 1]} be a harness with respect to some past-future filtration (Tit^T, t < 
T; t,T £ [0, 1]). Then the following properties hold. 

(i) The set of random variables {Y{s), < s < 1} is uniformly integrable. 

(ii) Y is continuous in probability, i.e., for any < t < 1 we have 

P (limY{s) = Y{t)^ =1. (5.3) 

hness2 

Proof. To prove (i), consider the collection of random variables {Y{s), < s < 1/2}. By (b.2), for 
t = 1/2, li = 1, we get 

^ " %Y{1) + —L^Y{s) = E (y(l/2) I ns,i) . 



eq: cont 



2 1 



2 1 
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As s varies between and 1/2, the collection of conditional expectations on the right is clearly uni- 
formly integrable. Thus, by rearranging terms and noting that Yi is integrable, we get {Y{s), < 
s < 1/2} is also uniformly integrable. By a similar argument one gets uniform integrability of 
{Y{s), 1/2 < s < 1}, and this shows uniform integrability of the entire process. 

For (ii), recall that we consider only right continuous harnesses. So it remains to prove that Y is 

.l eg :Imess2 

continuous in probability from the left at time t. By applying ( |b.2[ ), for any s < u < t < T we get 

u — s ^ , T — u, 
-Y{T) + 



¥.{Y{u)\n,^T) 



-Y{s). 



T-s ' ' T-s 

Now we take u approaching t from the left. By uniform integrability we get 

t-s^^,^, T-t 
-Y{T) + 



(5.4) 



limE (y(u) 

u-\t 



n 



E(y(t- 



n 



Y{s)=¥.{Y{t)\'H,,T) 



T-s ' ' T-s 

In other words, for all s < t < T we get E {Y{t-) \ 'Hst) = ^ {Y{t) \ Us r)- Now we take T 1 1 and 

KS 

use martingale convergence theorem ((see IjSi p. 18])) to claim E {Y{t—) \ V.s,t+) = E {Y{t) \ 7is,t+), 
where 'Hs,t+ = ^T>t'Hs,T- Finally we take s ^ t and the martingale convergence theorem to claim 



Here 'Ht-,t+ = \l s<t'^ 



E (y(t-) I nt-.t+) = E {Y{t) I 'Ht-,t+) . 

But Y{t—) is obviously measurable with respect to l-Lt-,t+ and Y[t+) 

= Y(t) almost surely. This shows 



is also measurable due to assumed right continuity. Hence Y{t 



■eg : pont 

(b.3) and completes the proof of the lemma. 



□ 



nov29 . 1 



To discuss the properties of a harness on a TLG Q we need to introduce a few definitions. Recall 
that a path in a graph is any sequence of vertices {ki, . . . , km) such that adjacent vertices {kj, kj+i) 
have edges in the graph Q. The only difference between a path and a time-path is that we do not 
require the vertices to be increasing. 

def : spine Definition 5.3. Let Q be an NCC TLG with finite V. Consider a full time path a* = cr^ki, . . . , kn) 
and a point t* G Ej*k* ■ Consider the subgraph Q* = (y*,£*) where V* consists of all vertices v £ Q 
such that there exists a path starting at v and ending at j* or k* and the path does not include 
any vertex in a*. The edges of this subgraph are the edges in Q such that both its vertices are 
included in V*. The full time path a* will be called a support for t* if the subgraph Q* is a tree. 
In other words, if we remove the time path a* from the graph Q, then the connected component of 
the remaining subgraph that contains t* is a tree. 

Let V denote the law of a Markovian harness in [0, 1]. Consider a natural 7^-process on an NCC 
TLG G. Suppose a full time path a* = cr{ki, . . . , kn) is a support for a non- vertex point t* on an 
edge Ej*jt*. We want to know what E[Xj^,k^,{t*) \ X{t), t £ a*) is. The answer will be expressed 
using a filtration constructed as follows. 

Let Wi denote the two vertices {tj*,tk*}- Let Gi denote the subgraph of G with the edge Ej*k* 
removed. Or, equivalently, in any representation of Q, we remove the interior of the set Ej*k*- Let 
Til denote the cr-algebra generated by the set of all random variables {XE{t), t £ E, E £ Qi}. 
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Note that the vertices j* and k* have degree two in the graph Qi since the common edge gets 
deleted. 

Now we proceed by induction. Suppose we have constructed yVm,Gm, and Tim such that every 
U G has degree two in the graph Qm- To construct Wm+i, consider sequentially every vertex 
U £ yVm- If ti is a vertex in a* (i.e., ti is one of {tk^, ■ ■ ■ ,tk„}), then ti continues to be in Wm+i- 
This, in particular, holds true if ti is or 1 which are in a*. In this case we define the set of 
descendants of ti, M{ti), as the singleton set {ti}. Otherwise, M{ti) consists of the two distinct 
neighbors of ti in the graph Qm- We define the set Wm+i as 

w„+i= U ^{-ti). 

The subgraph Qm+i is obtained from Qm by deleting all the vertices of Wm not included in Wm+i 
and all their incident edges. The a-algebra Hm+i is defined to be the one generated by all the 
random variables {XE{t), t £ E, E £ Gm+i}- 

We stop the inductive process at the first K when all vertices in Wk are in a* , which gives us a 
backward filtration 

nx C Uk-i C-- - CHi. 

1 Lemma 5.4. Suppose that a* is a support oft* so, by definition, Q* is a tree, 
(i) Unless ti is in a* , it cannot have a descendant already present in Wm- 
(a) Any V G Wm+i which is not included in a* has exactly two neighbors in the graph Qm+i- 
(Hi) There exists a tower of NCC graphs {Q[,Q2, . . . ,Q']^,Qk, ■ ■ ■ ,Gk-i, ■ ■ ■ ,Qk-2, ■ ■ ■ ,Gi,Q), 
where G[ is a graph with a single time path. In other words, every graph Qm, m = 1, . . . , K , is an 
element of this tower of NCC graphs. It is not necessarily true that Qm 's are consecutive elements 
in this tower. 

Proof. To see (i), consider two vertices ti < t2 in Wm- Note that there is always a path of the 
form (ti, ui, . . . , Ufc, ^2) such that {ui, . . . , Uk] is in IJi=^^ If *i ^'^d ^2 are neighbors, then that 
creates a loop in the graph Q* in Definition |b.3[ Smce we have assumed the graph Q* to be a tree, 
this is impossible. 

For (ii), note that, any v G Wm+i which is not in cr* is a neighbor to some distinct vertex in Wm 
and that edge has been deleted in Qm+i- Since the degree of every non-terminal vertex is three, it 
remains to show that v cannot be a neighbor to two (or three) vertices in Wm- 

Assume on the contrary that there is a vertex v G Wm+i which is a neighbor of both ui < U2, 
where ui,U2 G Wm- Since v ^ a* , this produces another loop in the graph Q* the possibility of 
which has been ruled out by our assumption. 

(iii) Let A be the connected component of TZ{G) \ cr* that contains t*. Then TZ{G) \ ^ = TI{Gk), 
by construction. We can reverse the construction presented before the lemma based on deleting 
edges. In the reversed construction we add edges one at a time, not in batches, to obtain a tower of 
graphs {Qk, - - - , Gk-i, - • - , Gk-2, ■ ■ ■ ,Gi,G). Every graph Gm, m = 1, . . . , K, is an element of this 
tower of graphs but ^m's are not necessarily consecutive elements. 
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We will argue that Gk is an NCC-graph. Suppose that Gk is not an NCC graph. Then, according 
to Definition BTB (v), there are minimal co-terminal cells [cri,a2) and ((T3,(T4) in Qx- Since A is 



a connected component of TZ{G) \ a*, it is easy to see that both cells ((Ti,(T2) and ((73,(74) will 
stay minimal if we add A to Qk- Hence, these cells will be minimal co-terminal cells in Q. This 
contradicts the assumption that G is NCC and finishes the proof that Qk is NCC. Hence, there 
exists a tower of NCC graphs (^[, • • • 1 ^M' ^k), where G'l contains only one full time path. We 
can concatenate this tower and {Gk, ■ ■ ■ , Gk~i, • • • 1 Gk-2, ■ ■ ■ to obtain a single tower of NCC 

graphs {G[,G2, • • • , Q'm^Qk, • • • , Qk-i, • • • , Qk-2, Qi,Q)- O 



prop:mgle Proposition 5.5. Let Q he a TLG with a full time path a* that is a support for a time point 
t G Ej*k*- Let X be a natural V-Markovian harness on Q. 

Let {/3(u), u > 0} 6e a one- dimensional Brownian motion independent of the V -harness X, with 
j3{Q) = t. We define the sequence of stopping times: 

C7i=inf{u>0: Piu) £ {tj^,tk*}} , 

and then inductively, 

am+i = inf {u>am- P{u) G N (/3(cTm))} . 
Then, for any m = 1,2, . . . , K , we get 

E{Xj,k*{t)\Um)=^(5 [X (/3(a™))] . 
Here is the expectation with respect to the law of /3, when the values of the process X are given. 

Proof. Consider the case of m = 1. By the graph-Mar kovian property of the process X, it is clear 
that 

E(X,-*fc.(t) I ni)=E{Xj*k* I X{t,.),X{tk*)). 
Now, applying the harness property |b.2p, we get 



E{Xj*k*(.t) I m 



tk 



^ XM+ 



t 



tk* 



x{t 



= F ip (ai) = tk*) X{tk*) +F iP (ai) = t,,) X{tj^) 

= Ep [X(/3(ai))]. 
We now proceed by induction. Suppose that 

E{Xj*k*{t)\nm)= ^{PM = ti)x{ti). 

Then, by the the tower property of conditional expectations, we get 

E{Xj*k*{t)\Um+l)= ^{Pi^m) = ti)E{X{ti)\nm+l). 

Now there are two cases to consider. First suppose that ti is in the fixed full time path a*, in 
which case it is measurable with respect to Tim+i, and thus E {X{ti) \ Tim+i) = X{ti). 

The other case is when ti ^ a*. Note that, since the degree of the vertex ti is exactly two in 
the graph Gm, there are two vertices vi and V2 such that if we remove these two vertices, ti is 



(5.5) eq: indmgle 



(5.6) eq:tower 
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disconnected from the rest of the graph. By Lemma (iii) and Remark ^.S ^iv) , the restriction 



of X to g m is a natural 'P-process. Thus, from the graph-Markovian property of X on Q^n and 
harness property 

E{X{U)\nrn+l)=E{X{ti)\X,„X,,) 

= P (/3 = t,, I /3(cj„) = ti) X{U,) + P (/3 ((T„+i) = I /3(a„,) = U) X{t,^). 

iitower || pr| • . IndmRle 



Substituting this expression back in |b.6p and (dTo) we get 



E{Xj,k'{t)\ 71^+1)= Yl ^iPi<^m+i) = U)XiU)=Ep[XiPiam+i))]. 
This completes the proof of the proposition. □ 



p:skorokhod Theorem 5.6. Let fi be any probability distribution on [0, 1]. Let Y be a Markovian harness with 
law V . 

(i) Given any e > and any metric p which induces the topology of weak convergence, it is possible 

construct a NCC TLG Q, a time point t* £ Ej*^*, and a full time path a* = cr(ifci)ifc2) • • • i^kn) 

such that for a natural harness X on G with law V , the difference between the laws of the random 

variables ^ 

E{Xj,k'{t*)\XEis), 0<s<l, E £a*) and [ Y{s)fi{ds) 

Jo 

is less than e in the metric p. 

(a) IfV is the Wiener measure on [0, 1], it follows that for any time point u G a* , one can make 
the difference between 



smaller than e. 



Proof. We use Dubins' solution to the Skorokhod embedding problem. Please see the original article 

pes , | np4 

by Dubins |2f for more details, or page 332 in the survey article by Obloj p2] (which treats the 

case when p is continuous). 

Given a measure p with support in [0,1], the Skorokhod problem asks for a stopping time r 
with respect to the Brownian filtration such that a standard one-dimensional Brownian motion /3 
stopped at r has law p. The following is a solution proposed by Lester Dubins. 

Consider any probability measure supported on [0, 1]. For any finite sequence s of O's and I's 
starting with 0, we will define a probability measure i^s- Let z^(o) = ^- Suppose that si = (s, 0) and 
S2 = (s, 1) (this notation is not quite rigorous but it is quite clear). It will suffice to define and 
i's2 as functions of Ug. If Vs is supported on exactly one point then we let = t^s2 = ^s- Otherwise 
we consider Vg restricted to intervals [0,E(z^s)) and [E(z^s),l]. We renormalize both measures and 
thus we obtain and Vs2- 

Let Hn{p) be the set of all numbers E{vs) for all sequences s of length n + 1, n > 0, where 
1/(0) = A*- The sequence {Hn{p), n = 0, 1, 2, . . .} can be naturally represented as a tree where every 
vertex has two descendants unless it is a vertex that is repeated forever. 



E {Xj^k*{t*)Xa*{u)) and / sp{ds) + up{u,l\ (5.7) eq:427 
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Let (3 denote a one-dimensional Brownian motion such that /3(0) = IE(/i). Define tq = and 
define the successive stopping times 

r„+i = inf {t > r„ : /3(t) € if„+i(/i)} , n = 0,1,2,... 

Then Dubins shows that the distribution /i„ of /3(t„) is supported on at most 2" many atoms, and 
moreover /i„ converges to /x weakly as n tends to infinity. 
We will later show that 



(y(/3(r„))) ^ / Y{s)d^,{s 



weakly as n tends to infinity. 



29.2 



(5. 



Assuming that is true, for any e > 0, there exist a large enough such that the /9-distance 

between Jy(s)d/i„(s) and jY{s)dfi{s) is smaller than e. This is enough to prove part (i) of 

the proposition since we can construct a tree Tn with vertices Ui^o-^*(/^) "^i^h an obvious tree 

structure. We add to Tjv a full time path a* by connecting {0, 1} with all the elements in H]\f. 

Finally we delete the vertex at IE(/i) and name this time point t* . Then a* is a support for the 

point t* . This and Proposition lb. b imply part (i) of the proposition. 

J pn • | ri29 . 2 

For part (ii) we note that when Y is Brownian motion, the weak convergence (b.8) entails 

convergence in L^. This is a standard result for linear combination of Gaussian processes that 

follows by considering pointwise convergence of the characteristic function. In other words, one can 

construct a tree as above with an N large enough such that the distance between 



IE(-^j*fe*(i) I T-I-n) and J X„^:{s)dfj.{s) 
is appropriately small. Now part (ii) follows by applying the Cauchy-Schwarz inequality since the 



J pn • ■ 427 

right side of (D77ns the covariance between J Xa*{s)diJ,{s) and Xo-*(t 



29.2 



We return to the proof of ( |b.8p . KT follows from Dubins' construction that there is a limiting 
stopping time r such that lim„_j.oo t„ = r almost surely, and lim„_>oo = where /3(t) has 

ll lem . : propharness 

law fi. Since (3 is independent of Y which is continuous in probability (Lemma lb.2), it follows that 



lim y(/3(r„)) = y(/3(r)), with probability one. 

n— >oo 
|1 PTTi, : propharness 



iLem.: propnarness 

By Lemma b?2 we know that {Y{s), < s < 1} is uniformly integrable, so the above shows that 
lim E« (y(/3(r„))) = EbY((3(t)), with probability one. 

n-^oo 

This completes the proof of the theorem. □ 



eq:n29.2 



6. Brownian motion on honeycomb graph 



sec :hcomb 

We will prove a limit theorem for natural Brownian motion on the honeycomb graph, when the 
diameter of hexagonal cells goes to zero. We will use the term "Brownian motion" to denote the 
two sided Brownian motion on the real line conditioned to be equal to at time 0. 
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Let TZ{Q*) consist of the boundary of a single hexagon with diameter p > 0, with two of its sides 
parallel to the first axis, and the leftmost vertex at (0, 0). Let TZ{Qp) be the usual hexagonal lattice 
in the whole plane, containing 'R.{Q*) as a subset. It is easy to see that there exists a tower {^^j 



of NCC TLG's with the limit Qp, satisfying Definition l2.ii (ii) so Qp is NCC. Hence, there exists a 

natural Brownian motion X on Qp. 

J gi2E.3 

Recall from Theorem BTBThat the distribution of X does not depend on the tower of NCC- 



graphs used in the inductive construction. Images of elements of a tower of NCC-graphs under 
the symmetry with respect to the horizontal axis form another tower converging to Qp. The same 
can be said about images under vertical shifts by the hexagonal cell height. This implies that the 
natural Brownian motion X on Qp is invariant under the symmetry with respect to the horizontal 
axis and under vertical shifts. 

p:nl4.1 Theorem 6.1. Let X be the natural Brownian motion on Qp. Consider (n,0),(f,x) G with 
u,v,x > 0. Let {up,Op) be one of the vertices in lZ{Qp) with the smallest distance to (u, 0) and let 
Eu be an edge ofQp that contains this vertex. Let {vp,Xp) be one of the vertices in lZ{Qp) with the 
smallest distance to (u, 4a;/(\/3/j)) and let be an edge of Qp that contains this vertex. Let <I> be 
the standard normal cumulative distribution function, i.e., ^{a) = (l/\/27r) J^^e~^^^^ds. Then 

limE(X^.K)X^.(.,)) = ^(e-i6(.+.)V(5.) _,-i6(«-.)V(5.)) 

- (l/2)(u - v){2<l>{4{u - v)/V5x) - 1) + (l/2)(tt + f)(2^>(4(u + v)/V5i) - 1). 

Remark 6.2. The above formula can be slightly simplified but we leave it in the present form to 
show that the expression is symmetric in u and v. This is evident once we recall that 2<I>(a) — 1 
is an odd function. Symmetry in u and v is something that we expect because of the invariance 
of X under the symmetry with respect to the horizontal axis and invariance under vertical shifts. 
Note that the formula does not depend only on |u — vj. This is because X is not invariant under 
horizontal shifts. The reason is that X{t) = 0, a.s., for every t of the form (0,y) € lZ{Qp)\ this is 
not true for any other vertex. 

Proof of Theorem lb'. 1 . 'I'he core of our argument is based on the harness idea, just like the argu- 




ments in Section! 

In this proof we will distinguish between points in the representation of a graph and their 
projections on the real axis. So far, this distinction was not very helpful so it was ignored in most 
^■f +1,^ -r^o-r^^v \\T^ ■,A^^i--,f^r „^^„o j?..^ with sets Ejk{[tj, tk\) C M^. Recall the following convention 





:2.4 


Li.4 





introduced after Definition WA tj = {tj, Ejk{tj)). As a first application of this notation, we write 



Vp = {vp,Xp) and Up = {up,Op). The meaning of X(t) for t £ Qp is clear. 

Recall that hexagonal cells in TZ{Qp) have diameter p and one of the vertices is located at (0,0). 
Let pi = /9\/3/4. 

We will construct a tower of finite NCC graphs. Let Li C T^iQp) be the graph of a non- decreasing 
function with a starting point (yi, 0) on the horizontal axis and endpoint at Vp. It is easy to check 
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that this defines Fi uniquely. Similarly, let r2 C TZ{Qp) be the graph of a non-increasing function 
with the starting point at Vp and an endpoint (y2)0) on the horizontal axis. Let C lZ{Qp) be 
the graph of a function on the interval (—00,00) with values in [— pi,0]; such a function is unique. 
Let r4 = Li U r2 U Fs and note that TZiGp) \ has two unbounded connected components, say, 
and Tq. Let Ly = TZ{Gp) \ (Ls U Lg). It is easy to see that Fy is a representation of a TLG G^:. 

All vertices of lZ{Qp) lie on lines Lj := {{t,x) : x = jpi}. Let Wj be the set of all vertices of 
TZ{Qp) that lie on IJn<j Let Qj = {yj,£j) be the graph obtained from Q^, by deleting all vertices 
in Tl{Q^) which are not in Wj and all corresponding edges. Note that 71(0 j) flLj 7^ but there are 
no vertices in Vj with representation in Lj. 

It is easy to see that Qj are elements of a tower of NCC graphs that starts from a graph with 
a single full time path represented by and ends with t/*. To construct such a tower, we add 
edges, one at a time, at the top layer of Gj, until we obtain Gj+i- A similar idea can be used to 
continue the construction of the tower beyond ^=1, , so that the union of all the graphs in the tower 

1125,. 3 iii2S,. 



is Qp. This construction, Theorem BT^lmd Remark BTS^lv) show that the restriction of X to Qj is 
a natural Brownian motion on Qj. 

Note that Xp is within distance pi of [V^x/{Ap)]. We define j* by {vp,Xp) G Lj„. Let W~ be 
the set of all vertices of the form (s, x) G T^iQp) with s < 0. Let Hk be the fi-field generated by 
{Xfj, a G £k} and by {X{t), t G W^}. The family {Tik} is a filtration, that is, Hk C Hk+i for all k. 
Consider a vertex t of whose representation belongs to Lk- Recall that t does not belong to Vk- 
Hence, t is in the interior of an edge in £k connecting two vertices in Vk H Lk-i- Let M{i) denote 
the set of endpoints of this edge and let M(t) be the projection of M{t) on the time axis. 

Let {Pui u > 0} be a one-dimensional Brownian motion independent of X, starting at (3q = Vp. 
We define a sequence of stopping times, starting with tq = and 

Ti = inf{n>0: Pu ^ Af (vp)} . 

Let /3(ri) be the point in M {vp) with the time coordinate /3(ti) and note that /S(ti) G Lj^^i. 
If l3{Tm) < then we let Tm+i = Tm- Otherwise we let 

Tm+i = inf {n > : /3« G (/3^„) } . 

Let /3(rm+i) be the point in A/" {Pr„,) with the time coordinate /3(Tm+i); then /3(rm+i) G Lj^^m-i- 
It follows from our definition of Q^ that A" C 7^(a*). 

Recall that for a random variable .Z^, E^Z denotes the expectation with respect to the law of /?, 
that is, a function of X. We have shown that the restriction of X to Qj is a unique in law natural 
Brownian motion on Qj. 

Let Mivp) = {^1,^2} C Wj,-i, with ti < t2- By the graph-Markovian property of X on the 
graph Qj,-i, 

^{X{vp) I = E {X{vp) I X(ti),X(t2)) . 
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Figure 4. The figure represents a fragment of the upper part of Gj. The points tk, 
k = 1,2, 3, 4, represent a possible path of m = j^, — — j + 1, . . . 



iness2 



Applying the harness property ( |b/2[ ), we get 



t2 — ti t2 — ti 

= F{f3 (n) = t2) X{t2) + P (/3 (ri) = h) X{h) 

= P (n) = h) xih) + P (^(n) = ti) x{ti) = {X (^,J) . 

We now proceed by induction. Suppose that 
Then, by the the tower property, we get 



^{X{Vp)\nj,^m-l) 



figS 



(6.1) eq:nl4.3 



(6.2) eq:nl4.4 



If ti e W- then E {X{ti) \ nj,-m~i) = X{ti). If U £ Wj^-m \ W" then let M{U) = {U,,U2} C 
From the graph-Markovian property and harness property applied to X restricted to 



E {X{ii) I Uj^-m-i) = E {X{U) I X(t,J,X(ti,)) 

= P (^ (r„+i) = ti, I ;5(r„) = ti) X{tiJ +F(p (r„+i) = \ ^(r„) = u) X{ti^). 

,| pq-nl4.3 ,| pq-nl4.4 

Substituting this expression back in ( |l6.i[ ) and ( |I6.2[ ) we get 

^{X{vp) I n,^-m-i) = P(^(r„^+i) =t.)X(t,) = IE/3 

We are interested in the case when — m — 1 = 0, that is, 

¥.{X{vp)\Uo)=^p (X(^_.^ 



(6.3) eq:nl5.1 



For integer m > 1, let B^p2 := /3^^ and define Bs for other values of s > by i?^ = -B[5/p2]p2. 
Let Cfc = -B(A:+i)p2 — B^,p2. Let i3s be the projection of Bs on the time axis and similarly, let Ck be 
the projection of Ck on the time axis. Let us ignore for the moment the possibility that (3 hits W~. 
The random variables Ck are not independent but they form a Markov chain. By ^ Example 2, 
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page 167] and ^ Theorem 20.1], when p — >• 0, the process Bs = '^k<[s/p'^]-i converges weakly in 
the Skorokhod space to Brownian motion Ws with a diffusion coefficient s. We wih next calculate 
s. 

The possible values of C^s are —3/9/4, — /o/4, p/4 and 3/9/4. If we list all states of Ck in this order 
then the transition matrix for this Markov chain is 

/ 1/4 3/4 \ 

1/4 3/4 

3/4 1/4 

\ 3/4 1/4 / 

The stationary distribution for Ck is (1/8, 3/8, 3/8, 1/8). Hence, in the stationary regime, 

ECl = (-3p/4)2(l/8) + (-p/4)2(3/8) + (p/4)2(3/8) + (3/9/4)2(1/8) = bp^Sl. 
Since the process i?fcp2 is a martingale, it follows that 

\ar{Bkp2 - Bo) = ^ VarC„= ^ bp"^ /32 = kbp"^ /32. 

0<n<fc-l 0<n<fc-l 

Hence, the diffusion coefficient s of Ws is y^5/32. 

Note that although we suppressed p in the notation for the process Bg , the distribution of this 
process depends on p. Recall that pi = /3\/3/4 and let As = Xp — spi for s > 0. Heuristically, 
(3^^ = {B,^p2,Am), m G Z, m > 0, is a space-time discrete time Markov chain, with the "time" 
Am running in the negative direction along the second axis, starting from Xp, and the speed of pi 
per one step. The "space" component B^p^ of this process runs along the ffist axis, starting from 

.| eq;pl5 . 1 

Vp. The right hand side of (1573) is evaluated by integrating the values of X with respect to the 



hitting distribution of Wq U by {Bmp2,A^). Since X{t) = for t of the form (0,y), Up > 
and X ^f3^. ^ < 0, we obtain from the graph-Markovian property E (^X{up)X (^f3^. = 0. For 
tuh G Lo, E{X{ti)X{t2))=hAt2. 

Let As = X — s for s > 0. When p — )■ 0, processes {Bsp2, piAs), s > 0, converge to space-time 
Brownian motion {Ws,As), s > 0, with {Wo,Aq) = {v,x), stopped at the exit time from the first 
quadrant, with the "time" component Ag running at the standard speed and the spatial component 
having diffusion coefficient s = y^5/32. Let r* be the exit time from the first quadrant by {Ws,As) 
and let t** be the exit time from the upper half-plane. Let K be the vertical part of the boundary of 
the first quadrant. Let / be the real valued function defined on the boundary of the first quadrant, 
with zero values on K and such that f{t, 0) = u A t for t > 0. Then, by weak convergence, and 
using ^fimip^oE{X{up)X{vp)) = Ef{Ar*,Wr*). 

Let (j){s) be the density of normal random variable with mean v and variance 5x/32, i.e., 

1 / (s-v? 
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Then using the reflection principle at the hitting time of K we obtain 

Urn E{Xiup)X{vp)) = Ef{Ar*,Wr*) 

p—>-0 

= Ef{Ar» , Wr** ) - E {f{Ar** , Wr*^ ) ,W^*)^K}) 

u POO \ / r—u 

s(j){s)ds + / u^{s)ds ) — [ {—s)(f){s)ds + / u(t){s)ds 

Ju / \J —u J —oo 



/u roo r — u 

s(p{s)ds + / u(j){s)ds — I u(l){s)ds 
-u Ju J —oo 



u 

5x 



- {l/2){u - v)(2$(4(u - v)/V5x) - 1) + (l/2)(u + v){2^{4{u + v)/V5x) - 1). 

□ 
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